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Derivative of BICM Mutual Information 

Albert Guillen i Fabregas and Alfonso Martinez 

Abstract 

In this letter we determine the derivative of the mutual information corresponding to bit-interleaved 
coded modulation systems. The derivative follows as a linear combination of minimum-mean-squared 
error functions of coded modulation sets. The result finds applications to the analysis of communications 
systems in the wideband regime and to the design of power allocation over parallel channels. 

I. Introduction, Motivation and System Model 

Bit-interleaved coded modulation (BICM) is an attractive solution to construct coded mod- 
ulation schemes over non-binary signal constellations by concatenating a binary code with a 
non-binary modulator through an interleaving permutation [1], [2]. We study the sub-optimal 
non-iterative BICM decoder proposed in [1]. This decoder, when combined with Gray mapping 
is shown to have a capacity very close to that of coded modulation [2]. 

The derivative of the mutual information as a function of the signal-to-noise ratio (SNR) is 
becoming increasingly relevant in the analysis and optimisation of communications systems [3], 
[4]. Reference [5] introduces a fundamental relationship between the minimum mean-squared 
error (MMSE) and the mutual information in additive Gaussian channels. In particular, [5] obtains 
that the derivative of the mutual information with respect to SNR is equal to the MMSE in 
estimating the input given the output of a Gaussian-noise channel. Beyond its own theoretical 
interest, this relationship has proved instrumental in optimising the power for parallel channels 
with arbitrary input distributions and in obtaining the minimum bit energy to noise ratio for 
reliable communication [3]. 

In this letter, we give a formula for the derivative of the mutual information of BICM in 
Gaussian channels. The formula can be efficiently evaluated numerically without resorting to 
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lengthy Montecarlo simulations, which makes it particularly attractive. In particular, we consider 
a Gaussian-noise channel 

y = y/snrx + z (1) 

where y,x,z e C L are the output, input and noise vectors. We assume that the noise samples 
zi are independent and identically distributed ~ Ac(0, 1) and therefore snr denotes the SNR. 
We assume that x E X L are BICM codewords, where X C C is the signal constellation, with 
m = log 2 \X\. Furthermore, we assume we employ BICM with the decoder of [1], [2]. Then, the 
input-output mutual information of BICM /£ lcm (snr) can be expressed as the mutual information 
of m binary-input continuous-output symmetric parallel channels [2] 



/£ cm (snr) = X>(snr) = X> 



i=i i=i 



V- p -\V^r(X-x')+Z\ 

log T 



V p -\^(X-x')+Z\ 2 



(2) 



where the sets XI contain all signal constellation points with bit b in the i-th binary labeling 
position, and the expectation is over the signal constellation points in X£, over the bits b and noise 
Z. All results in this letter assume natural logarithms. The BICM mutual information expression 
can be very efficiently evaluated numerically using Gauss-Hermite quadratures [6]. The binary- 
input continuous-output equivalent BICM channel has a noise which is neither additive nor 
Gaussian, so the results of [5] cannot be directly applied to compute the derivative of the mutual 
information. 

II. Main Result 

The main result of this letter is given by the following Theorem. 
Theorem 1: The derivative of the BICM mutual information is given by 



d/£ icm (snr) 



m 1 

Z~l 2 E ( mnr| se*(snr) - mmse^(snr)) (3) 



rfsnr 

i=l 6=0 

where 

2 



mmse^(snr)=E[|A| 2 ]- 2 ^E \\ 

aeA 



V n' p -\V^(a-a>)+z\ 2 



V , , e -\V^(a~a')+z\^ 



e'^dz (4) 



is the MMSE of an arbitrary input signal constellation A. 

Proof: Recent results [7], [8], introduce the following alternative expression for the BICM 
mutual information 

rn 1 

4 icm (snr) = 2 E (^ m ( snr ) " J ^( snr )) 

i=l 6=0 
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where J™ (snr) is the mutual information for coded modulation over signal constellation A C C. 
Combining © with the fundamental relationship between mutual information and MMSE [5] 

— ^ — - = mmse^lsnr) (6) 
asnr 

we obtain the desired result, where mmse^(snr) denotes the MMSE of an arbitrary input signal 
constellation A. ■ 

Remark that A need not have zero mean nor unit variance. The expression for the MMSE 
© can again be efficiently evaluated using the Gauss-Hermite quadratures [6]. Note that, since 
the BICM equivalent channel has a noise which is not additive nor Gaussian, Eq. © is not the 
MMSE in estimating the input bits given the output. 

The expression © finds application in power allocation over parallel channels with BICM. 
Following [3], the result can be used to optimise the power required to maximise the mutual 
information of parallel channels subject to a given power constraint. The result can also be used 
to minimise the outage probability over nonergodic block-fading channels [3], [4]. 

Figure \T\ shows an example of the computation of the derivative of the BICM mutual infor- 
mation with 16-QAM modulation. The MMSE for Gaussian inputs and coded modulation with 
16-QAM are shown for comparison. For Gray mapping (dashed line) we observe a very good 
match at high snr. At low snr, the behaviour is given by [8] 

rbicm 



d J y-cr )=E i E | 

snr^o dsnr ^2^1 » l J 

i=l b=0 

In order to show this result, one may use the methods in [8] or use the fact that 



(7) 



and inserting it into ©. 



lim mmse^(snr) = E[\A\ 2 } - \E[A]\ 2 (8) 

snr— >0 



III. Conclusions 



We have given an expression for the derivative of the mutual information of BICM, which is 
a linear combination of MMSE functions for coded modulation. The expression can be easily 
evaluated using numerical integration, and is instrumental in analysing the behavior of BICM 
in the wideband regime, as well as in deriving optimal power allocation schemes for parallel 
channels with BICM. 
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Fig. 1. Derivative of the mutual information for Gaussian inputs (thick solid line), 16-QAM coded modulation (solid line), 
16-QAM BICM with Gray mapping (dashed line) and 16-QAM BICM with set partitioning mapping (dotted line). 
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